Temporal scaling of dopamine neuron firing and dopamine release by distinct ion channels shape behavior.

Dopamine is broadly implicated in reinforcement learning, but how patterns of dopamine activity are generated is poorly resolved. Here, we demonstrate that two ion channels, Kv4.3 and BKCa1.1, regulate the pattern of dopamine neuron firing and dopamine release on different time scales to influence separate phases of reinforced behavior in mice. Inactivation of Kv4.3 in VTA dopamine neurons increases ex vivo pacemaker activity and excitability that is associated with increased in vivo firing rate and ramping dynamics before lever press in a learned instrumental paradigm. Loss of Kv4.3 enhances performance of the learned response and facilitates extinction. In contrast, loss of BKCa1.1 increases burst firing and phasic dopamine release that enhances learning of an instrumental response and enhances extinction burst lever pressing in early extinction that is associated with a greater change in activity between reinforced and unreinforced actions. These data demonstrate that disruption of intrinsic regulators of neuronal activity differentially affects dopamine dynamics during reinforcement and extinction learning.

A midbrain dynorphin circuit promotes threat generalization.

Discrimination between predictive and non-predictive threat stimuli decreases as threat intensity increases. The central mechanisms that mediate the transition from discriminatory to generalized threat responding remain poorly resolved. Here, we identify the stress- and dysphoria-associated kappa opioid receptor (KOR) and its ligand dynorphin (Dyn), acting in the ventral tegmental area (VTA), as a key substrate for regulating threat generalization. We identify several dynorphinergic inputs to the VTA and demonstrate that projections from the bed nucleus of the stria terminalis (BNST) and dorsal raphe nucleus (DRN) both contribute to anxiety-like behavior but differentially affect threat generalization. These data demonstrate that conditioned threat discrimination has an inverted "U" relationship with threat intensity and establish a role for KOR/Dyn signaling in the midbrain for promoting threat generalization.

Persistent activation of central amygdala CRF neurons helps drive the immediate fear extinction deficit.

Fear extinction is an active learning process whereby previously established conditioned responses to a conditioned stimulus are suppressed. Paradoxically, when extinction training is performed immediately following fear acquisition, the extinction memory is weakened. Here, we demonstrate that corticotrophin-releasing factor (CRF)-expressing neurons in the central amygdala (CeA) antagonize the extinction memory following immediate extinction training. CeA-CRF neurons transition from responding to the unconditioned stimulus to the conditioned stimulus during the acquisition of a fear memory that persists during immediate extinction training, but diminishes during delayed extinction training. Inhibition of CeA-CRF neurons during immediate extinction training is sufficient to promote enhanced extinction memories, and activation of these neurons following delay extinction training is sufficient to reinstate a previously extinguished fear memory. These results demonstrate CeA-CRF neurons are an important substrate for the persistence of fear and have broad implications for the neural basis of persistent negative affective behavioral states.

Synergy of Distinct Dopamine Projection Populations in Behavioral Reinforcement.

Dopamine neurons of the ventral tegmental area (VTA) regulate reward association and motivation. It remains unclear whether there are distinct dopamine populations to mediate these functions. Using mouse genetics, we isolated two populations of dopamine-producing VTA neurons with divergent projections to the nucleus accumbens (NAc) core and shell. Inhibition of VTA-core-projecting neurons disrupted Pavlovian reward learning, and activation of these cells promoted the acquisition of an instrumental response. VTA-shell-projecting neurons did not regulate Pavlovian reward learning and could not facilitate acquisition of an instrumental response, but their activation could drive robust responding in a previously learned instrumental task. Both populations are activated simultaneously by cues, actions, and rewards, and this co-activation is required for robust reinforcement of behavior. Thus, there are functionally distinct dopamine populations in the VTA for promoting motivation and reward association, which operate on the same timescale to optimize behavioral reinforcement.

Dopamine Neurons Reflect the Uncertainty in Fear Generalization.

Generalized fear is a maladaptive behavior in which non-threatening stimuli elicit a fearful response. Here, we demonstrate that discrimination between predictive and non-predictive threat stimuli is highly sensitive to probabilistic discounting and increasing threat intensity in mice. We find that dopamine neurons of the ventral tegmental area (VTA) encode both the negative valence of threat-predictive cues and the certainty of threat prediction. As fear generalization emerges, the dopamine neurons that are activated by a threat predictive cue (CS+) decrease the amplitude of activation and an equivalent signal emerges to a non-predictive cue (CS-). Temporally precise enhancement of dopamine neurons during threat conditioning to high threat levels or uncertain threats can prevent generalization. Moreover, phasic enhancement of genetically captured dopamine neurons activated by threat cues can reverse fear generalization. These findings demonstrate the dopamine neurons reflect the certainty of threat prediction that can be used to inform and update the fear engram.